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Abstract 

The main result of this letter is that SOC naturally arises as a result of 
memory effects. 

We show that memory effects provide the mechanism for self organiza- 
tion. A general procedure to investigate this issue in models that display 
self organized critical behaviour is proposed and applied to some example. 
The simplest class of models exhibiting self organized criticality through this 

mechanism is introduced and discussed in some detail. 
PACS: 02.50-r, 05.40+j, 05.40jk 
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A large amount of efforts have been recently devoted to uncover the mechanism underly- 
ing the tendency of large statistical systems to self organize into a critical stateEHI. This issue 
has a great relevance since self organized criticality (SOC) manifests itself in a large variety 
of phenomena ranging from earthquakes^ to magnetic systemJBi, from interface growthiS 
to biological evolutionS. 

Much interest has focused on recently proposed models that involve quenched disorder0'i 
and whose dynamics leads spontaneously to a SOC state. The occurrence of critical aspects 
in connection with a dynamics in a random environment is not a peculiarity of these models: 
invasion percolation^ (IP) is known to reproduce the critical clusters of standard percolation 
right at the percolation threshold; non trivial space-time correlations also appear in spin 
glasses dynamics!, charge density wavesEl and in zero temperature dynamics of magnetic 
system^0 in quenched disorder. Criticality is related to the presence of memory in these 
systems. By this we mean that the dynamic of local variables is sensible to a long period of 
the past history of the process. 

This letter we inquire on the relation between dynamics in quenched disorder, memory 
effects and SOC. First we discuss how memory arises in models that evolve in a random 
environment. Then we show that a SOC behavior does not necessarily imply the presence 
of memory. We suggest that instead the converse is true: Memory, i.e. the dependence of 
local dynamics on the whole history of the process, implies a self organized critical behavior. 
This issue is analyzed with the introduction of a model that contains the effects of memory 
explicitly. In this model there is no reference to quenched random variables. For a particular 
value of the exponent that tunes the effects of the past history on the evolution, we reproduce 
the result of the corresponding dynamics in quenched disorder. The occurrence of SOC 
behaviour for a whole range of this exponent suggests that criticality is not a peculiarity of 
dynamics in quenched disorder but rather it arises as a result of memory effects. 

The simplest model of dynamics in quenched disorder is perhaps the Bak Sneppen0 
model (BSM) originally devised to model biological evolution: assign a uniformly distributed 
random variable (RV) rji on each site i of a (i-dimensional lattice. At each time step select 



the smallest RV and replace it and the RV's on the neighboring sites with newly extracted 
uniform RV's. The system self organizes to a "critical" steady state in which almost all RV's 
are above a certain threshold value pc- This state is characterized by long range correlations, 
both in space and in time, that have been studied by different technique^SS. 

Imagine to assign to each site of the lattice a counter variable fcj. At time t the variable 
ki is set to zero if the variable rji is updated and it is increased by one otherwise. In this 
way ki(t) is the time elapsed since the last update on site i. 

In a system that evolves probing a random environment, as the BSM and invasion per- 
colation where the extreme statistics of a random field is selected at each time, it is natural 
to think that the evolution will take place more often on recently updated regions than in 
older ones. This is because a site whose RV has been checked a large ^ 1 number of times 
in the search for the minimum RV will probably have a large RV. It still has a probability 
of being the smallest in the future but this probability gets smaller and smaller as time 
goes on. This implies that the probability that a site with a counter equal to k is selected 
decreases with k. 

It is possible^, keeping track of the evolution of the statistics of the RV on each site, to 
pursue this argument further and to evaluate the probability of each selection event, that is 
the probability that a random variable rji, that has a counter ki{t), is the smallest one. This 
in principle provides a stochastic formulation of the process, that is deterministic for each 
realization of the randomness. We will not enter the details of this (the interested reader 
is referred to0) but just note that the probability that site i is the smallest can be labeled 
by ki and evaluated for invasion percolation, under approximations of mean field type, with 
the result0 

Probjr], = mm[r]j; Vj]} = Hk^t ~ k'"" (1) 

for t ^ ki ^ 1 with a = 2. It is worth to stress here that fik,t is not a function of k alone in 
models like invasion percolation. In a single realization it actually depends on finer details 
of the past history. However, on average, it displays a fairly stable power law dependence 
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on k. 

The distribution fi^ t is a directly accessible quantity in a computer simulations. Indeed 
the fraction of times selection occur on a site with ki = k will be nk^tf^k,t, where Uk^t is the 
number of sites with counter ki{t) = k aX time t. 

We will be concerned mainly with the stationary state of a system of linear size L with 
periodic boundary condition. In the steady state the above distributions attain a constant 
value fik{L) and nk{L). These satisfy the normalization conditions J2k fJ'k{L)nk{L) = 1 and 
J2k''^k{L) = L'^ for a system of linear size L. 

A measure of the effect of memory is given by the first moment of the distribution nk{L) 

1 oo 

m) = -Y.knk{L)r^L'^^'^<\ (2) 

^ k=0 

The exponent C is a measure of the presence of memory effects. On the average the local 
dynamic of the variable on site i is sensible to a period of the past history of the process. If 
the length of this period, measured in units of L'^ individual events, increases with L, i.e. if 
C > 0, the state of the infinite system will depend on the whole history. If = we can say 
that no memory effect is present. 

Counter variables can be introduced in any system. Consider e.g. the Metropolis 
dynamics^ of the Ising model. A variable is selected on average once every L'^ attempts. 
With a probability that does not depend on L the move is accepted and the spin flipped. 
Thus we expect C = fo^' this model and in general for equilibrium dynamics. Consider next 
the prototype model of SOC, the sandpile mo delS: sand is added on randomly chosen sites. 
A site cannot store more than 2d — 1 grains and it "topples" when it receives the 2d}^ one, 
i.e. it distributes one grain to each of its neighbor sites causing eventually "toppling" on 
these sites as a result. After a toppling a site is empty. Before it will topple again it needs 
to store enough sand. Thus the probability that it will topple after k toppling events grows 
with k and on the average it will topple once every L"^ toppling events. Then C = also in 
this case. This result is consistent with the abelian nature of this mo deli. The BSM has 
instead a non-abelian evolution and figure indeed shows that the situation is different in 



this case. ^k{L) actually decays as a power law with k with an exponent ubsm = 1.30±0.02 
and nk{L) satisfies the scaling behavior 



with (3bsm = 0.58 ± 0.01. 

The scaling function f{x) drops quickly to zero for large arguments and tends to a 
constant /(O) = ni{L) for x — > 0. The assumption of a single time scale Too{L) for a given 
size is implicit in (|]). If /5 < 1, the normalization condition on nk{L) easily yields the 
exponent relation 



This yields (bsm — 1-44 in fair agreement with the direct measure (bsm = 1.46 ±0.03 using 



If ( is the indicator of the relevance of memory, the self organized nature is usually 
related to the occurrence of avalanche events. An avalanche event is made of a spatially 
and causally connected series of events. In the BSM the selection and update of one site at 
time t may generate RV's that are smaller than the one that has just been selected. The 
evolution will naturally select these RV at time t + 1. The same may happen for a certain 
period and as a result selection events will be localized in a small region. At each time one 
avalanche starts so a number of nested avalanches are active at each time. In the SOC state 
the duration s of an avalanche follows a power law distribution N{s) ~ s""^ that defines the 
exponent r. An avalanche that lasts a time s typically extends on a region ^ ~ s^. 

The definition of an avalanche is particularly simple in terms of the variables ki. Consider 
the avalanche started at time to- This will be active at time to + s if all sites i{t) selected 
at times to < t < + s had a counter ki(^t){t) ^ t — to, i-e. all these sites where generated 
after the avalanche began. On the other hand the selection of a site with a counter k at 
time t terminates all avalanches that started after time t — k. The size of an avalanche that 
lasts for s time steps is simply evaluated as the size of the region with counters smaller than 
ki < s. 




(3) 



eq.(l). 
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The key points we have reached up to now with the introduction of counter variables are: 
i) dynamics in quenched disorder leads to memory effects and is characterized by power law 
behavior in both fik{L) and nk{L). ii) the mechanism of self organization is not the same in 
sandpile mo delsB, that display no memory effect, and in the BSM. in) We can describe both 
memory effects and avalanche events in terms of counter variables alone. These observations 
motivates the introduction of a new model defined in terms of counter variables alone to 
study the interplay between the effects of memory and self organization. 

The model we are going to discuss is defined as follows: assign a counter variable ki to 
each site z = l,...,Lofal dimensional lattice. At each time step one site is selected, with 
a probability /x^- that depends on the value of the counter 

/ifc = /xo(A; + l)-°. (5) 

When a site is selected its counter variables and that of its neighbor sites are set to zero. 
All other variables are increased by one: 

ki+5{t + l) = Q for5 = 0,±l (6) 
k^(t + l) = kj{t) + 1 else. (7) 

The dependence of the selection probability on k is devised to generalize the situation 
occurring when the dynamics is driven by the extreme statistics of a random field. The 
larger the time a region has been tested for selection the smallest the probability it will be 
selected. This is the simplest way to account for a dependence of the local dynamics on 
the history of the process and the rules of the model may apply also to situations where no 
disorder is present. 

For a finite L the system gets to a steady state that is characterized by a distribution of 
counters nk{L) for which we shall assume the scaling form eq.(^). Of course uqIL) = 3 since 
three counters are updated at each time step. The normalization of the selection probability 
J2T=o^k{L)fik{L) = L fixes the value of fio{L): 

^'^^^ = 3 + Er^in,(L)(A: + l)-- 
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Let us start the discussion of the model from the a = case. Clearly fio{L) = 1/L at 
all times. The nk{L) instead decays exponentially. A simple explanation of this comes from 
the relation between the number of sites with ki{t + 1) = k + 1 and ki{t) = k. In the steady 
state this reads nk+i{L) = nk{L){l — 3/L). This immediately yields nk{L) = 3exp(3/c/L) 
and ({a = 0) = P{a = 0) = 0. Of course the probability of a connected event of s steps 
also goes to zero exponentially with s, i.e. r(a = 0) = 0. In conclusion neither memory nor 
avalanches are present in the model for a = 0. The same behavior is expected to persist for 
small values of a. Let us focus on a site with ki = k and consider the probability Pk{s) that 
it will not be selected in the next s steps, under the condition that in this period it will not 
be updated because of its neighbors. Clearly Pk{s) = Yljtk+ii'^ " A^oJ"")- K is not difficult 
to check that, if a < 1, Pk{s) — > as s — oo while it tends to a constant if a > 1. So 
this site, if it is not updated by its neighbors, will surely be selected sooner or later. This 
suggests that for a < 1 the average time Too{L) between two updates of the same site stays 
finite and ({a < 1) = l3{a < 1) = (see eq.(^). The occurrence of SOC can be excluded as 
well for a < 1. The probability of local, causally connected events (the avalanches) depends 
on fio{L). The existence of such events on all length and time scale requires this probability 
to stay finite independent of L. Supposing the scaling form (0) for nk{L) in eq.(^, it is 
easy to see that if a + /3 > 1, as L — > oo, fio{L) — > fio^oo) > 0, while in the opposite case 
/io(oo) = 0. 

Let us now consider the opposite case: a = oo. In this case /i^ = V/c > and /iq = 1/3. 
The model describes a random walk on a c? = 1 lattice. It is not difficult to find C{oo) = 1 and 
a distribution nk{L) that follows eq.^with /5(oo) = 1/2. With respect to SOC, the evolution 
is a single connected event: every avalanche lasts for an infinite time. For a finite a > 1 it 
is convenient to generalize the avalanche distribution to account for infinite avalanches: 

N{s) = (1 - N^)Nf{s) + N^6s,oo. (9) 

A^oo is the fraction of avalanches that never stop. The lack of characteristic lengths in the 
model suggests that the distribution of finite avalanches Nf{s) will in general follow a power 
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law distribution. An avalanche of duration s is terminated when a site with ki > s is selected. 
If fcmax(^) = niax[/cj(t), -i = 1, . . . , L], all the avalanches that began before time t — k^^yr[t) 
will never be terminated. The probability that an avalanche is still active after s events is 



p.ctis) = n 



t=i 



1 -Yj'^kiL)nkiL) 



(10) 



k>t 

Supposing again eq.(||) for nk{L), the sum in eq.([lO|) goes as k^^"'^^ so that Pact(s) 
if a + (3 {a) < 2. For large a a finite fraction of avalanche events will never stop while we 
expect a finite interval a G [1, ad where Noo{a) = and the usual scenario of SOC applies. 

This picture was checked by computer simulation of the model. For a < 1, as expected, 
HoiL) ~ L^'^ vanishes with uj{a) = 1 — a. Table lists the values obtained for the exponents 
f3 and ( by numerical simulations of the model for sizes up to L = 256 and a > 1. The 
statistical uncertainty gets large as a = 1 is approached from above. The relation (^) is 
satisfied fairly well, a + P{a) gets bigger than 1 for a = 1.4. Correspondingly, as expected, 
A^oo becomes positive. This is shown in fig.^ where we report also the estimate of the 
exponent r obtained for L = 128 and 256. The distribution Nf{s) was found to decay as 
a power law for more than two decades but the value of the exponent actually decreases as 
L increases. For small a the statistics of avalanches gets scarcer and scarcer and a reliable 
estimate was not possible. Even though of a qualitative nature, the behavior of r(a) is 
quite evident from figure |^. r reaches a minimum approximately in the same region where 
a + P = 1 and A^oo starts to increase. The last occurrence would naturally arises as a result of 
the divergence of the normalization integral of N{s) that occurs for r = 1. This would imply 
a systematic error in our r data of approximately +0.3. With this proviso we find that, for 
a = ubsm = 1-30, the exponent should be tbsm ~ 1-1 in good agreement with numerical 
results for the BSM0i. With respect to the BSM, it is to note that the values of [3 and 
C agree with those obtained for a = 1.30. We confirmed numerically that Noc,{L) ~ /,-o-98 
goes to zero for the BSM. 
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FIG. 2. Fraction of infinite avalanches N^{a) in a system with L = 128 and r(a) exponent. 
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TABLES 



^ P c 

1.10 0.3 ± 0.1 0.5 ± 0.2 

1.20 0.48 ± 0.01 0.90 ± 0.04 

1.30 0.58 ± 0.01 1.40 ± 0.06 

1.40 0.619 ± 0.005 1.53 ± 0.03 

1.50 0.613 ± 0.005 1.47 ± 0.03 

1.75 0.571 ± 0.005 1.31 ± 0.03 

2.00 0.545 ± 0.005 1.17 ± 0.02 

2.50 0.510 ± 0.005 1.06 ± 0.02 
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